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AMENDMENTS TO THE CLAIMS: 

This listing of claims will replace all prior versions, and listings, of claims in the 
application: 

LISTING OF CLAIMS: 

Claim 1 (Original). An apparatus for extracting an object from an image, comprising: 

an image input unit for receiving a query image including an object and an 
object extraction target image from which the object included in the query image is to 
be extracted; 

an object position determination unit for determining a position of the object in 
the object extraction target image using pixel based color feature matching; 

an image segmentation unit for segmenting each of the query image and the 
object extraction target image into a plurality of regions using image features 
including color or texture; and 

an object region determination unit for performing matching between the 
segmented regions in the query image and the segmented regions in the determined 
position of the object in the object extraction target image using color or texture 
features and determining a final object region using similarity in spatial adjacency 
between matching regions obtained as a result of the matching. 
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Claim 2 (Currently amended). The An apparatus of c l aim 1 for extracting an object 
from an image, comprising: 

an image input unit for receiving a guerv image including an object and an 
object extraction target image from which the object included in the guery image is to 
be extracted; 

an object position determination unit for determining a position of the object in 
the object extraction target image using pixel based color feature matching; 

an image segmentation unit for segmenting each of the guerv image and the 
object extraction target image into a plurality of regions using image features 
including color or texture; and 

an object region determination unit for performing matching between the 
segmented regions in the guerv image and the segmented regions in the determined 
position of the object in the object extraction target image using color or texture 
features and determining a final object region using similarity in spatial adjacency 
between matching regions obtained as a result of the matching , wherein the object 
position determination unit comprises: 

a color histogram calculator for calculating color histograms with respect to 
the query image and the object extraction target image; 

an image projector for replacing the pixel values with respect to the query 
image and the object extraction target image with ratio histograms; and 
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a candidate object position determiner for determining candidate object 
positions in the object extraction target image having the ratio histogram. 

Claim 3 (Original). The apparatus of claim 2, wherein the color histogram calculator 
calculates the number of pixels in a quantized color space with respect to each of the 
query image and the object extraction target image. 

Claim 4 (Original). The apparatus of claim 2, wherein the candidate object position 
determiner performs convolution on the value of a mask determined based on a 
minimum bounding box surrounding the object included in the query image and the 
object extraction target image having the ratio histogram, calculates color distance 
differences between pixels with respect to which the resulting values of the 
convolution is no less than a predetermined threshold in the object extraction target 
image, and determines pixels as candidate object positions according to the average 
of color distance differences obtained with respect to each of the pixels in increasing 
order of the average. 

Claim 5 (Currently amended). The apparatus of claim 4- 2, wherein the image 
segmentation unit segments the query image and the object extraction target image 
into regions using the image features including color or texture. 
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Claim 6 (Original). The apparatus of claim 4 2, wherein the object region 
determination unit comprises: 

a region matching unit for performing region matching with respect to the 
segmented regions of the query image and segmented regions corresponding to the 
object position in the object extraction target image using image features including at 
least color and texture and determining whether the object extraction target image 
includes an object according to the result of region matching; 

an adjacency matrix calculator for calculating a spatial adjacency matrix with 
respect to the segmented query image and calculating a spatial adjacency matrix 
with respect to an image resulting from the region matching on the segmented object 
extraction target image which is determined as having the object; 

a correspondence region detector for detecting correspondence regions 
between the query image and the object extraction target image using the adjacency 
matrixes calculated by the adjacency matrix calculator; and 

a similarity calculator for calculating the similarity between the query image 
and the object extraction target image based on the correspondence regions and 
determining a final object region. 
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Claim 7 (Original). The apparatus of claim 6, wherein the region matching unit 
detects a segmented region, which includes a pixel at the determined position of the 
object and meets a mask determined based on a region surrounding the object in the 
query image, in the segmented object extraction target image, calculates a similarity 
distance between each detected region and each of the segmented regions of the 
query image, and determined whether the object extraction target image includes the 
object. 

Claim 8 (Original). The apparatus of claim 6, wherein the adjacency matrix calculator 
assigns label numbers to the segmented regions of the query image and to 
segmented regions including the object of the query image in the object extraction 
target image and forms adjacency matrixes in which each element has a first value 
when corresponding regions are adjacent and has a second value when they are not 
adjacent, the adjacency matrixes showing information about how adjacent the 
segmented regions assigned the label numbers are in the query image and the 
object extraction target image, respectively. 
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Claim 9 (Original). The apparatus of claim 6, wherein the correspondence region 
detector forms a comparison matrix using the adjacency matrixes in different 
manners according to whether the number of the segmented regions in the query 
image is greater or less than the number of segmented region in the object 
extraction target image to show the correspondence regions between the query 
image and the object extraction target image. 

Claim 10 (Original). The apparatus of claim 6, wherein the correspondence region 
detector forms a comparison matrix using the adjacency matrixes and using only 
segmented regions, which have most similar image features to the segmented 
regions having label numbers in the query image, in the object extraction target 
image to show the correspondence regions between the query image and the object 
extraction target image. 

Claim 11 (Original). The apparatus of claim 10, wherein the correspondence region 
detector determines the segmented regions having the most similar image features 
to the segmented regions of the query image in the object extraction target image 
using a distance matrix and reconstructs the comparison matrix according to the 
correspondence regions between the query image and the object extraction target 
image. 
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Claim 12 (Original). The apparatus of claim 11, wherein the distance matrix has the 
label numbers of the query image as row values and has the label numbers of the 
object extraction target image as column values, and each element in the distance 
matrix is a distance between a region assigned one of the label numbers in the query 
image and a region assigned one of the label numbers in the object extraction target 
image. 

Claim 13 (Original). The apparatus of claim 8, wherein the similarity calculator 
calculates the similarity by dividing the number of elements having the first value in 
an upper triangular matrix by the number of all elements in the upper triangular 
matrix in the comparison matrix. 

Claim 14 (Original). A method of extracting an object from an image, comprising the 
steps of: 

(a) receiving a query image including an object and an object extraction target 
image from which the object included in the query image is to be extracted; 

(b) determining a position of the object in the object extraction target image 
using pixel based color feature matching; 

(c) segmenting the query image and the object extraction target image into a 
plurality of regions using image features including color or texture; and 
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(d) performing matching between the segmented regions in the query image 
and the segmented regions in the determined position of the object in the object 
extraction target image using color or texture features and determining a final object 
region using similarity in spatial adjacency between matching regions obtained as a 
result of the matching. 

Claim 15 (Currently amended). : Fhe A_method of extracting an object from an image, 
cla i m 1 4 , wh e r e in th e st e p (b) compr i s e s comprising the steps of: 

(a) receiving a guerv image including an object and an object extraction target 
image from which the object included in the guerv image is to be extracted; 

(b) determining a position of the object in the object extraction target image 
using pixel based color feature matching; 

{b4} (c) calculating color histograms with respect to the query image and the 
object extraction target image; 

{b2) (d) replacing the color histograms with respect to the query image and 
the object extraction target image with ratio histograms; aa4 

(b3) (e) determining candidate object positions in the object extraction target 
image having the ratio histogram; 

(f) segmenting the guerv image and the object extraction target image into a 
plurality of regions using image features including color or texture; and 
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(g) performing matching between the segmented regions in the query image 
and the segmented regions in the determined position of the object in the object 
extraction target image using color or texture features and determining a final object 
region using similarity in spatial adjacency between matching regions obtained as a 
result of the matching . 

Claim 16 (Currently amended). The method of claim 15, wherein the step (M-c) 
comprises calculating the number of pixels at each bin in a quantized color space 
with respect to each of the query image and the object extraction target image. 

Claim 17 (Currently amended). The method of claim 16, wherein the step (b2 d) 
comprises calculating the ratio histogram by dividing the number of pixels in each bin 
with respect to the query image by the number of pixels in all bins with respect to the 
query image. 

Claim 18 (Currently amended). The method of claim 16, wherein the step (b2 d) 
comprises defining the ratio histogram as a ratio of the number of pixels in each bin 
with respect to the query image to the number of pixels in each bin with respect to 
the object extraction target image. 
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Claim 19 (Currently amended). The method of claim 15, wherein the step (b3 e) 
comprises the steps of: 

(b3-4 el) performing convolution on the value of a mask determined based on 
a minimum bounding box surrounding the object included in the query image and the 
object extraction target image having the ratio histogram, 

e2) calculating color distance differences between pixels with respect to 
which the resulting values of the convolution is no less than a predetermined 
threshold in the object extraction target image; and 

(b3-3 e3) determining pixels as candidate object positions according to the 
average of color distance differences obtained with respect to each of the pixels in 
increasing order of the average. 

Claim 20 (Original). The method of claim 19, wherein the mask at a pixel (x p , y p ) is a 
circle defined by 



bl indicates the length of the longer side of the bounding box, bs indicates the length 
of the shorter side of the bounding box, and a indicates a variable for adjusting the 
size of the mask. 



W =\ 



' 2 55^(x-x p ) 2 +(y-y p ) 2 < WR 



0, otherwise 



WR = a \bs + 
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Claim 21 (Original). The method of claim 19, wherein the average color distance 
difference is defined by 

AD pixeicolor = -L 2 V(^-^) 2 +(^-^) 2+ (^-^) 2 

A/ indicates the number of valid pixels within the bounding box, q indicates the query 
image, and d indicates the object extraction target image. 

Claim 22 (Currently amended). The method of claim 44 15, wherein the step (4 g) 
comprises the steps of: 

gl) performing region matching with respect to the segmented regions of 
the query image and segmented regions corresponding to the object position in the 
object extraction target image using image features including color or texture and 
determining whether the object extraction target image includes an object according 
to the result of region matching; 

(42 g2) calculating a spatial adjacency matrix with respect to the segmented 
query image and calculating a spatial adjacency matrix with respect to an image 
resulting from the region matching on the segmented object extraction target image 
which is determined as having the object; 

(d3g3) detecting correspondence regions between the query image and the 
object extraction target image using the adjacency matrixes calculated in step (42 
g2); and 



Attorney's Docket No. 030681-356 
Application No. 10/050,547 
Page 13 



(44 g4) calculating the similarity between the query image and the object 
extraction target image based on the correspondence regions and determining a 
final object region. 

Claim 23 (Currently amended). The method of claim 22, wherein the step g1_) 
comprises the steps of: (44-4 g1-1) detecting a segmented region, which includes a 
pixel at the determined position of the object and meets a mask determined based 
on a region surrounding the object in the query image, in the segmented object 
extraction target image; and (44-2 g1-2 ) calculating a distance difference in color or 
texture between each detected region and each of the segmented regions of the 
query image to determine whether the object extraction target image includes the 
object. 

Claim 24 (Original). The method of claim 23, wherein the distance difference in color 
or texture is defined as a distance between two regions in a space of an image 
feature including color or texture, the distance between two regions is calculated 
from 

D CT (x,y)= wMx ' y) + W ' DXx ' y) 

D c (x,y) and D t (x,y) indicate a distance between two regions x and y in a color space 
and a distance between the two regions x and y in a texture space, respectively, and 
w c and w t indicate weight coefficients, respectively, applied to the respective 
distances. 
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Claim 25 (Currently amended). The method of claim 22, wherein the step (42 g2) 
comprises assigning label numbers to the segmented regions of the query image 
and to segmented regions including the object of the query image in the object 
extraction target image and forming adjacency matrixes in which each element has a 
first value when corresponding regions are adjacent and has a second value when 
they are not adjacent, the adjacency matrixes showing information about how 
adjacent the segmented regions assigned the label numbers are in the query image 
and the object extraction target image, respectively. 

Claim 26 (Currently amended). The method of claim 22, wherein the step (d3 g3) 
comprises forming a comparison matrix using the adjacency matrixes in different 
manners according to whether the number of the segmented regions in the query 
image is greater or less than the number of segmented region in the object 
extraction target image to show the correspondence regions between the query 
image and the object extraction target image. 

Claim 27 (Currently amended). The method of claim 22, wherein the step (d3 g3) 
comprises forming a comparison matrix using the adjacency matrixes and using only 
segmented regions, which have most similar image features to the segmented 
regions having label numbers in the query image, in the object extraction target 
image to show the correspondence regions between the query image and the object 
extraction target image. 
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Claim 28 (Currently amended). The method of claim 22, wherein the step (€& g3) 
comprises determining the segmented regions having the most similar image 
features to the segmented regions of the query image in the object extraction target 
image using a distance matrix and reconstructing the comparison matrix according to 
the correspondence regions between the query image and the object extraction 
target image. 

Claim 29 (Original). The method of claim 28, wherein the distance matrix has the 
label numbers of the query image as row values and has the label numbers of the 
object extraction target image as column values, and each element in the distance 
matrix is a distance between a region assigned one of the label numbers in the query 
image and a region assigned one of the label numbers in the object extraction target 
image. 

Claim 30 (Currently amended). The method of claim 22, wherein when each element 
in the adjacency matrixes has a first value when corresponding regions are adjacent 
and has a second value when they are not adjacent, the step (d4 g4) comprises 
calculating the similarity by dividing the number of elements having the first value in 
an upper triangular matrix by the number of all elements in the upper triangular 
matrix in the comparison matrix. 
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Claim 31 (Currently amended). The method of claim 26 or 27, wherein in the step 
(d4 g4), the similarity is calculated from 




and when each element in the adjacency matrixes has a first value when 
corresponding regions are adjacent and has a second value when they are not 
adjacent, E u indicates the number of elements having the first value in an upper 
triangular matrix of the comparison matrix, and M u indicates the number of all 
elements in the upper triangular matrix. 

Claim 32 (Currently amended). A computer readable recording medium on 
which a program for executing the method of any one of claims 44 15 through 31 in a 
computer is recorded. 



